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Control Contraction Metrics: Convex and Intrinsic Criteria for 

Nonlinear Feedback Design 

Ian R. Manchester Jean-Jacques E. Slotine 


Abstract —We introduce the concept of a control contraction 
metric, extending contraction analysis to constructive nonlinear 
control design. We derive sufficient conditions for exponential 
stabllizabllity of all trajectories of a nonlinear control system. 
The conditions have a simple geometrical interpretation, can be 
written as a convex feasibility problem, and are invariant under 
coordinate changes. We show that these conditions are necessary 
and sufficient for feedback linearizable systems, and also derive 
novel convex criteria for exponential stabilization of a nonlinear 
submanifold of state space. We Illustrate the benefits of convexity 
by constructing a controller for an unstable polynomial system 
that combines local optimality and global stability, using a metric 
found via sum-of-squares programming. 

1. Introduction 

The concept of a Lyapunov function is central in nonlinear 
system analysis, and builds upon the intuitive notion of a 
system’s energy dissipating over time [1], [2]. For nonlinear 
control design, the natural extension is the control Lyapunov 
function (CLF): a generalized measure of energy that can be 
made to decrease by choice of control action, first formalized 
in [3], [4] though implicit in earlier works. 

If a CLF can be found, then surprisingly simple formulas 
yield stabilizing feedback designs for quite broad classes of 
systems [5], [6, Ch. 4]. However, the fundamental problem of 
finding a CLF remains challenging. For mechanical and elec¬ 
trical systems, physical energy often yields effective choices 
[2], while for systems of particular “triangular” structures, 
backstepping and related methods can be applied [1], [6]. 

For linear systems, a straightforward change of variables 
converts the CLF criteria to a linear matrix inequality (LMI) 
[7], [8], but for nonlinear systems the set of CLFs for a partic¬ 
ular system is not necessarily convex or even connected [9]. 
The density functions of [9], the occupation measures of [10], 
and the Lyapunov measures of [11] each offer “dual” represen¬ 
tations that yield convex (but generally infinite-dimensional) 
searches guaranteeing almost-everywhere stability. Computa¬ 
tionally tractable finite-dimensional approximations have been 
based on gridding or the sum-of-squares relaxation [12]. 

The main result of this paper is that if the nonlinear 
stabilization problem is studied dijferentially, then the simple 
convexification results for linear systems are recovered by 
generalising the concept of a contraction metric. 

Contraction analysis is based on the study of a nonlinear 
system by way of its differential dynamics (a.k.a. variational 
system) along solutions [13]. Roughly speaking, since the 
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differential dynamics are linear time-varying (LTV), many 
techniques from linear systems theory can be directly ap¬ 
plied. A central result is that if all solutions of a smooth 
nonlinear system are locally exponentially stable in a common 
metric, then all solutions are globally exponentially stable. 
Historically, basic convergence results on contracting systems 
can be traced back to the results of [14] in terms of Finsler 
metrics, further explored in [15], while convex conditions for 
existence and robustness of limit cycles were given in [16]. In 
contraction analysis, question of stability is decoupled from 
the specification of particular solutions, and this property is 
also relevant for control design: it is common in industrial 
plant-wide control and robot motion control to have a “layered 
architecture” in which a higher-layer generates target trajecto¬ 
ries, and a lower layer guarantees accurate tracking. 

In this paper we introduce universal stabilizability: the 
property that every forward-complete solution of a system can 
be globally stabilized. We then define a control contraction 
metric (CCM) for a nonlinear system, and show that existence 
of a CCM is sufficient for universal exponential stabilizability. 
We also give extensions for stabilization of submanifolds. 

The CCM stabilizability condition has a simple geometric 
interpretation: small displacements in directions orthogonal to 
the span of the control inputs must be “naturally” contracting. 
Here both the notions of orthogonality and contraction depend 
on the choice of metric. This can be thought of as a differential 
version of the CLF condition of [3], [5]. While the resulting 
conditions are arguably quite strong, in contrast to a CLF 
our criteria for the existence for a CCM can be formulated 
as a convex feasibility problem. Furthermore, unlike e.g. 
backstepping they are invariant under smooth changes of 
coordinates and affine feedback transformations, and necessary 
and sufficient for feedback linearizable systems. 

The feedback controllers we propose will generally involve 
real-time optimization to find a minimal-length path with 
respect to the metric (a geodesic) joining the current state to 
the desired state. This problem is generally simpler than that 
in nonlinear model predictive control (MFC) since it has lower 
dimension, lacks dynamic constraints, and minimal geodesics 
are guaranteed to exist [17]. If a state-independent metric 
exists, then geodesics are just straight lines and our method 
is closely related to well-known methods using quadratic 
Lyapunov functions, e.g. [7, p. 99] and [18]. 

The main feedback controller we propose is smooth almost 
everywhere, but as with nonlinear MFC, our controller may 
be discontinuous at some points in state-space. To ensure 
existence of solutions at such points, we also propose a 
sampled-data controller that runs open-loop short intervals, a 
common strategy in nonlinear MFC [19], and similar to the 
notion of s-stability introduced in [20]. 
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II. Preliminaries and Problem Setup 

For symmetric matrices A, B the notation A> B (A > B) 
means that A — B is positive semidefinite (positive definite). 
The non-negative reals are denoted IR+ := [0,oo). Given a 
smooth matrix function M{x,t) and vector field v : M" x 
IR+ —)• M” defined for a; € M", f € M"*", we use the following 
notation for directional derivative dyM := A set of 

sample times is a sequence to, ti, ... with to = 0 and ti < ti+i 
for all i and —>■ oo as i —)■ oo. 

In this paper we consider control-affine nonlinear systems: 

X = f{x,t) + B{x,t)u (1) 

where x{t) € € K™ are state and control, respec¬ 

tively, at time t G M"*", and /, B are smooth functions of their 
arguments. We denote the column of B{x,t) by bi{x,t). 
We assume u{t) is at least piecewise-continuous, and (1) holds 
with the right-derivative at points of discontinuity. 

We define a target trajectory to be a forward-complete 
solution of ( 1 ), i.e. a pair {x*,u*) with x* : M'*' —)■ M" 
piecewise differentiable and u* : M"*" —>■ piecewise- 

continuous satisfying ( 1 ) for all t G M’*'. 

We will consider open-loop, sampled-data and continuous 
feedback controllers. An open-loop controller is a mapping 
{x{0),x*{-),u*{-),t) I—)■ u{t). Given a set of sample times, 
a sampled-data feedback controller has the property that 
on each interval [ti,ti+i), the control law is a mapping 
{x{ti),x*{t),u* I—>■ u{t), while a continuous feedback 
controller is a mapping {x{t),x*{t),u*{t),t) ^ u{t). 

A target trajectory x*, u* is said to be globally exponentially 
controllable (resp. stabilizable) if one can construct an open- 
loop (resp. feedback) controller such that for any initial 
condition x( 0 ) G M", a unique solution x{t) of ( 1 ) exists 
for all t and satisfies 


\x{t) — X*{t)\ < e '^‘i?|x( 0 ) — a;*( 0 )|, ( 2 ) 


where rate A > 0 and overshoot i? > 0 are constants 
independent of initial conditions. If every target trajectory is 
globally exponentially controllable (resp. stabilizable) then the 
system is said to be universally exponentially controllable 
(resp. stabilizable). The following example illustrates the 
distinction with global stabilizability of a particular solution. 

Example 1: Consider the planar system 


±1 


—2xi + xf — X 2 

_i2_ 


— 6 x 2 + 2 xiX 2 


1 

0 


u, 


which has four equilibria [9]: {xi,X 2 ) = (0,0), (2,0) and 
(3, ±v^)- The origin is globally exponentially stabilized by 
the feedback law u = — since the quadratic Lyapunov 

function V (x) = -f verifies V = —4xf — 12a;| < —4V. 
However, notice that if 2 : 2 ( 0 ) = 0 then 2 : 2 (f) = 0,Vf > 0 
regardless of xi,u, so it is impossible for a control input 
to move the state from the line 2:2 = 0 to the equilibria at 
(3, ±v^). Therefore this system is not universally stabilizable. 

We utilize the following standard results of Riemannian 
geometry, see, e.g., [21] for details. A Riemannian metric 
is a smoothly-varying inner product (•,-)a; on the tangent 
space of a state manifold A"; this defines local notions of 


length, angle, and orthogonality. In this paper X = M" and 
the tangent space can also be identified with M". We allow 
metrics to be smoothly time-varying, and use the following 
notation: (( 5 i,( 52 )x,t = 5 [M{x,t )52 and ||(5||a;,t = s/{5, 5)x,t- 
We call a metric uniformly bounded if 3 a 2 > 0:2 > 0 such 
that ail < M(x,f) < 0 : 2 / for all x,t. For a smooth curve 
c : [0,1] —)■ M" we use the notation Cs(s) := and define 

the Riemannian length and energy functionals as 

L{c,f) := f ||cs||c,t(is, E{c,f) := 

20 

respectively, with integration interpreted as the summation 
of integrals for each smooth piece. Let F be the set of 
piecewise-smooth curves [ 0 , 1 ] —> K", and for a pair of points 
x,y G M”, let r(x,y) be the subset of F connecting x to y, 
i.e. curves c G r( 2 ;,t/) if c G F, c(0) = x and c(l) = y. 
A smooth curve c(s) is regular if 7 ^ 0 for all s G [0,1]. 
The Riemannian distance d{x, y, t) := i'ntc^r{x,y) L{c, f), and 
we define E{x,y,f) := d{x,y,f)‘^. Under the conditions 
of the Hopf-Rinow theorem a smooth, regular minimum- 
length curve (a geodesic) 7 exists connecting every such pair, 
and the energy and length satisfy the following inequalities: 
E(x,y,t) = E{'y,t) = < L{c,t)‘^ < E{c,t) where c 

is any curve joining x and y. For time-varying paths c{t, s), 
we also write c(t) := c(t, •) : [ 0 , 1 ] —> M”. 

A central result of [13] is that if there exists a uniformly 
bounded metric M{x,f) such that lil + ^ M + < 

—2AM, where M = ^ -f dfM, then the system is 
contracting with rate A, i.e. ^||4|U,t < -A||4|U,i- By 
integrating along minimizing geodesics, we see that d(x, y, t) 
and E{x,y,f) between any pair of points x,y both decrease 
exponentially under the flow of the system, and thus can 
serve as incremental Lyapunov functions. Such systems are 
called contracting systems and M is n contraction metric. 
Similarly, we call a system strictly contracting with rate A 
if ^\\Sx\\x,t < -A||4|U.t for 4 f 0. Since M(x,t) > 0, 
a system which is contracting with rate A > 0 is strictly 
contracting with any rate less than A. 

III. Control Contraction Metrics 

To analyse stabilizability we utilize the “extended” system 
consisting of ( 1 ) paired with its differential dynamics: 

6 x = A{x,u,t)dx + B{x,t)Su, (3) 

defined along solutions x{t),u(t), where A := ^ + 

V™ ^ 11 - 

Z^i=l dx “*■ 

Let us begin by examining the case when a known controller 
makes the system contracting, and yet is flexible enough that 
any target trajectory of ( 1 ) remain possible in closed-loop. 

Proposition 1: Suppose there exists a smooth feedback 
control law u = k{x, t)+v that makes the closed-loop system 
strictly contracting with rate A in some metric M{x, t) for any 
piecewise-continuous signal v{t). Then for all x,u,t 

M + (A + BK)'M + M(A + BK) < -2AM, (4) 

where K = ^, and for 6 x 0 the following is true: 

SxMB = 0 S'x:(M + A'M + MA + 2XM)Sx <0. (5) 
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It is clear that (4) => (5); the proof of (4), and all subsequent 
results in this paper, are collected in the appendix. 

Since (5) is independent of the particular control law 
k, it describes an intrinsic property of the system ( 1 ): if 
= 0 for all i = then ^|| 4 IU,t < 

I-C. every tangent vector 5x orthogonal to the span 
of actuated directions bi{x) is naturally contracting with rate 
X. It is interesting to ask whether (5) implies the existence of 
some form of stabilizing control for any target trajectory. Our 
main theoretical result is that this is indeed the case: 

Theorem 1: If there exists a uniformly-bounded metric 
M{x,t), i.e. ail < M{x,t) < 02 /, for which (5) holds for 
all Sx 0,x,u,t, then System (1) is 


1 ) universally exponentially open-loop controllable, 

2 ) universally exponentially stabilizable via sampled-data 
feedback with arbitrary sample times, 

3) universally exponentially stabilizable via continuous feed¬ 
back defined almost everywhere, and everywhere in a 
neighbourhood of the target trajectory. 


all with rate A and overshoot R = , 

V ^2 

We refer to a metric satisfying the conditions of this theorem 
as a control contraction metric (CCM) for the system (1). The 
proof of this theorem is given in the appendix, but here we 
briefly describe the main idea and construction of controllers. 

Given a CCM, Lemma 2 in the appendix establishes the ex¬ 
istence of a differential feedback controller 5^ = ks{x, Sx, u, f) 
that achieves closed-loop exponential stabilization of the dif¬ 
ferential dynamics (3) along all solutions: 


dt 


{S'xMSx) 


6 '^M6x + 2S'^M{A6x + Bks) < -2X5'^M5a, 


and furthermore, is path-integrable, so that for any smooth 
path c G r and any u* G K"* and t G K'*', the following 
integral equation has a unique solution: 


kp{c,v*AiS) ■■= u* + / ks{c{5),Cs{5),kp{c,u* 

Jo 

( 6 ) 

The motivation for this construction is to give a smooth path 

dk 

of control signals kp with tangent vectors = ks for all 
s G [0,1] and boundary condition fcp = m* at s = 0. 

The path-integrability condition is a significantly weaker 
requirement than the ks being completely integrable, i.e. of 
the form ks = K{x,t)bx, with K the Jacobian of a feedback 
controller, as was assumed in Proposition 1. This distinction 
will be important for our convex conditions in Section III-B. 

1) Open-Loop Control: For ti > 0, consider a bounded 
or unbounded time interval in one of the following forms: 
T = [L,L+i), T = [U,ti+i] or T = [L,cx)). 


1) At the initial time ti measure x{ti) and construct a 
smooth path c{ti) G r{x*{ti),x{ti)). 

2) For each f G T, apply the control signal u{t) = 
A:p(c(f), u*(t), f, 1 ), where c{t) is the forward image of 
the path c{ti) with the path of controls ( 6 ), i.e. for each 
s G [0,1] and t G T, c(t, s) satisfies 


d 

dt 


c{t,s) = f{c{t, s),t)-\-B{c{t,s),t)kp{c{t),u*{t),t,s). 

(7) 



Fig. 1. An illustration of the geometry of solutions using the open-loop 
or sampled-data CCM-based control over an interval The target 

trajectory x*{t) is shown in red, system trajectory x(t) in black. Paths joining 
x*(t) to x(t) are shown in blue. 


When this strategy is applied on an interval T = [fi,oo) the 
length of the curve c{t) shrinks exponentially, and allows us 
to establish Theorem 1 claim 1. 

The bound R = given in the theorem is achieved 

if the initial path cq is a minimal geodesic joining x*{ti) to 
x{ti), existence of which is established in Lemma 1 in the 
appendix. With any other initial path, exponential stability 
is still achieved with the same rate but perhaps with larger 
overshoot. Note that when c(L) is a geodesic it is in general 
not the case that c{t) is a geodesic for t > ti, see Fig. 1. 

2 ) Sampled-Data Feedback Controller: The open-loop con¬ 
troller can be extended to sampled-data feedback by recom¬ 
puting geodesics at the sampling instants. To be precise: 

1) At each sample time L, measure the state x{ti) and 
compute a minimal geodesic 7 ^ G argmiucgTi-£'(c, L) 
where F^ := T{x*{ti),x{ti)). 

2 ) On the interval T =\ti, L+i) apply the open-loop control 
described above with cifi) = 7 ^. 

Note that this is stabilizing with any choice of sample times, 
including uniform sampling: L = itg for some fixed tg > 0. 

3) Smooth Feedback, Uniquely Defined Almost Everywhere 
and in a Neighbourhood of x*: By taking the limit as 
sampling interval goes to zero, one can obtain a continuous¬ 
time controller which does away with the need to solve (7) 
over the inter-sample intervals. Specifically: 

1) Measure the state x{t) and a minimal geodesic 7 = 
argmincgr(a:*(t),a:(t)) B{c, U). 

2) Apply the control signal u{f) = kp{'j,u*{t),t,l). 

This defines a mapping {x(t),x*{t),u*{t),t u{t), however 

a difficulty is that it may be multiply-defined or non-smooth at 
some states x(t), specifically points on the cut locus, denoted 
by €.{x*,f), which is the set of points for which non-unique 
minimizing geodesics exist from x* (cut points) and/or the 
first-order minimality condition fails (conjugate points). 

This set is known to have zero Lebesgue measure. Let use 
deflne D{x*,t) := K"'/(£(a;*,/)Ua;*) which is diffeomorphic 
to punctured open ball. For every x G there is a 

unique minimal geodesic 7 joining x and x* [21, Ch 13], and 
we show in the appendix that the above controller is smooth 
on '£){x*,f) and continuous at x = x*{t). This controller 
is universally exponentially stabilizing under the technical 
assumption that the set of times at which x{t) G <L{x*,t) 
has zero measure. 
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A. Stronger Conditions Giving Simpler Controllers 

Since the differential dynamics are linear, it is tempting to 
look for an admissible differential feedback controller of the 
form 6 u = K{x,t)Sx satisfying (4). We will show that this is 
possible under the following slightly stronger conditions: 

Cl: if Sx 0 satisfies = 0, then 

i;(“+3/M+|M + Mg+2AM)i.<0, 

C2: for each i = 1, 2,m, db^M + ^ M + M^ = 0. 

These stronger conditions also hold under the assumptions 
of Proposition 1, as is clear from the proof in the appendix. 
Condition Cl says that the uncontrolled system is contracting 
in directions orthogonal to the span of the control inputs. 
Condition C2 ensures that large u of unknown sign cannot 
cause expansion of ||5a;|j. Formally it states that the vector 
fields bi are Killing fields for the metric M. 

In particular, if B is of the form [0, /]', with 0 and I the zero 
and identity matrices of appropriate dimension, then Condition 
C2 says that M must not depend on the last m state variables. 
By applying Finsler’s theorem (see, e.g., [22]) pointwise in x 
and t to condition Cl, we immediately obtain the following: 

Proposition 2: Condition Cl is equivalent to the existence 
of a scalar multiplier p{x, t) such that for all x, t: 

dM df' df 

— +dfM+y:fM + My:f-pMBB'M + 2XM<0. (8) 

ot ox ox 

One can then construct the differential feedback gain 
K{x,t) = —\p{x,t)B{x,t)'M{x,t) which satisfies (4) and 
is always path integrable since it is independent of u. 

Remark 1: If ( 8 ) holds for some multiplier p{x, t) = 
po{x,t), then it clearly holds for any p{x,t) > po{x,t) for 
all x,t since MBB'M > 0. This can be interpreted as the 
differential feedback having infinite up-side gain margin, and 
also implies that one can construct a smooth p{x,t). 

B. Dual Metrics and Convexity of Synthesis 

It is known that the search for a CLF for a linear system 
is convexified by a simple change of variables, leading to an 
LMI representation of stabilizability [7], [ 8 ]. In this section 
we show that essentially the same transformation makes the 
search for a CCM convex. 

Consider the change of variables p = M{x,t)6x and 
W{x,t) = M{x,f)~^. This is related to the “musical isomor¬ 
phism” to the dual space of cotangent vectors, and the function 
rj'Wrj is the Fenchel dual of 5'xM5x, so we refer to kF as a 
dual CCM. Under this change of variables, the CCM condition 
(5) now states that p'(-lU -f AW + WA' + 2XW)p < 0 
whenever rj'B = 0, which can be written as 

Bf (^-W + AW + WA' + 2XW^ B_l < 0, (9) 

for all X, u, t, where B'j_{x, t) is any matrix function satisfying 
B'^B = 0 for all x,t- Since differentiation is a linear 
operation, the inequality (9) linear (and hence convex) in the 
unknown matrix function W. 


One can search directly for differential feedback = 
K{x,u,t)5x by way of W and Y(x,u,t) G satisfying 

. B f 3 f' 

-W + T^W + W^ +BY + Y'B' + 2A1U < 0, (10) 

Ox Ox 

giving the differential feedback gain K = YW~^. If Y, and 
hence K, are at most affine in u then the resulting differential 
control will be path-integrable, similarly to Lemma 2. 

Condition Cl can be written similarly to (9), and by 
Finsler’s theorem is equivalent to the existence of a scalar 
function p{x, t) satisfying the inequality 

dW df df' 

—-- dfW + ^W + W^ - pBB' + 2XW <0. (11) 

dt Ox dx 

which is jointly convex in W and p, and gives an explicit 
construction of a differential feedback gain K = —^pB'W~^. 

Condition C2 also transforms to a linear constraint on W\ 

db^W-^^W-W^^' = 0. 

The above conditions are all convex but infinite¬ 
dimensional: they are inequalities that must hold over all 
X G M" and t G M+, and the decision variables are sets of 
smooth matrix functions. Finite-dimensional LMI approxima¬ 
tions can be constructed by building W and p oi Y as linear 
combinations of a finite basis set (e.g. polynomials up to some 
order), and verifying the inequalities either by gridding over 
states and times, or by the sum-of-squares relaxation [ 12 ]. 

Remark 2: Note that complete integrability of 
ks{x,Sx,t) = K{x,t)Sx could be imposed by requiring 
that each row of K satisfies the Schwarz condition, i.e. 

While this constraint is linear and hence 

OXp, 

convex in K, it is not convex jointly in the decision variables 
W,Y for (10), since K = YW~^, or the decision variables 
W, p for (11), since K = —^pB'W~^. This is essentially the 
same problem as the well-known non-convexity of structured 
feedback synthesis for linear systems e.g. static output 
feedback [23]. 

IV. Properties oe Control Contraction Metrics 
A. Riemannian Energy as a CLF 

The proof of Theorem 1 uses an explicit construction of 
a particular stabilizing controller, but in doing so we have 
actually shown that the Riemannian energy E{x,x*,t) can 
always be decreased, and hence be used as control Lyapunov 
function (CLF) for any target trajectory of the system. 

The formula for first variation of energy [21, p. 195] gives 
a particularly convenient expression for the time derivative of 
the energy functional as an affine function of u: 

x*)x*,t - 

1 OE 

- {Y,{t,^),Bix,t)u)x,t + (12) 

When x{t) G €{x*,t) the above formula still holds with = 
replaced by < and ^ replaced by the Dini derivative. 

In proving Theorem 1, we have also proven that for any 
the convex set (either a half-space or all of M™): 

U = ^ G R"' : ^E{x,x*,t) < —2XE{x,x*,f^ > 
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where -^E{x,x*,t) is given by ( 12 ), is always non-empty. 

This opens up the possibility of using many other particular 
controllers based on CLFs that may have further desirable 
properties. For example, pointwise min-norm control [ 6 ]: 
u{t) = sxgmva.u^u Hitlp would have reduced control magni¬ 
tude, and can be generalized to provide approximate optimality 
with guaranteed stability [24]. 


is not feedback linearizable in the sense of [25], since the 
vector fields B and adfB := ^B — = [ 2 x 2 , 0 ]' are not 

linearly independent when X 2 = 0. However, it is universally 
stabilizable as verified by (11) with W = I and multiplier 
p{x) = 1-1- 2 ^ 2 . Additionally, since we can take Bx = [1 0]', 
condition (9) reduces to the fact that = —l — 3xf < 0 Vx. 


B. Invariance Under Coordinate Change and Feedback 

Metrics and dual metrics are tensors: geometrical objects 

that are ‘intrinsic” and have coordinate representations that 
transform appropriately under smooth coordinate changes. In 
the following theorem we establish that the CCM criteria 
are invariant under such coordinate changes and, additionally, 
under affine feedback laws. 

Theorem 2: If the CCM condition (5) (or equivalently (9)) 
is satisfied for system (1), then (5) and (9) still hold under: 

1) affine feedback transformations u{x,v) = a{x) + /3{x)v 
with P a smooth non-singular n x n matrix function. 

2 ) differential coordinate changes 6 ^ — <I)(x)(5a;, in which 
<I)(x) is a non-singular matrix for all x, with the new 
CCM M^(x,f) := T''(x)M(x,f)T'(x) and dual CCM 
W^{x,t) := $(x)VF(x,f)<I)(x)', where T'(x) = $(x)“^; 

3) coordinate changes ^ = (j){x), (p a smooth diffeomor- 

phism, with the new CCM and dual CCM as 

above with $(x) = ^ evaluated at x = 

Remark 3: If $(x) has bounded singular values over all x, t 
within [(Tmin, CTmax], then the uniform bounds on M and W 
are also preserved under coordinate change. 

C. Necessity for Feedback Linearizable Systems 

A corollary of Theorem 2 is that for feedback linearizable 
systems, existence of a CCM is guaranteed. A system of 
the form (1) is feedback linearizable if there exists a change 
of variables and feedback transformation such that the trans¬ 
formed system is linear time-invariant: ^ + Hv, where 

the pair of constant matrices {G,H) is controllable [1]. 

Corollary 1: For any feedback linearizable system there 
is a control contraction metric that verifies universal stabi- 
lizability, given by W{x,t) = ^{x,t)P^{x,t)' where P 
is any constant symmetric positive definite matrix satisfying 
H±{GP + PG')Hf < 0. 

The proof is immediate from Theorem 2, and we note that 
such a P is guaranteed to exist if {G,H) is stabilizable [8]. 

The converse is not true: the necessary and sufficient con¬ 
ditions for feedback-linearizability consist of a controllability 
condition and an involutivity (complete integrability) condition 
to find an appropriate coordinate change [1]. In contrast, 
existence of a CCM depends only on stabilizability, and does 
not require complete integrability of the differential control. 
This is because a metric corresponds to a differential change 
of coordinates 5z = Q{x,t)6x, i.e. M = 0'0, but there is 
no requirement that this should be integrable to an explicit 
change of coordinates z = 9{x). 

Example 2: The following system 

u =: /(x) -I- Bu 


d 

dt 


Xi 


X2 



— Xi — xf + X2 


V. Stability and Stabilization of Submanifolds 


Convergence of a nonlinear system to a submanifold of state 
space is a requirement that appears in many applications, in¬ 
cluding coordination of multi-agent systems [26], synchroniza¬ 
tion of oscillators [27], computational neuroscience [28], and 
nonlinear control design [29]. Design of controllers to stabilize 
submanifolds has been investigated recently using transverse 
feedback linearization [30], reduction and backstepping [31], 
and modifying controllers for drift-free systems [32]. 

Suppose a submanifold is defined by a level set of some 
smooth funciton Z(t) = {x : z{x,t) = c} where z : K” x 
IR+ —)■ and || has rank q for all x. The sets Z{t) are 

called controlled invariant if there exists a smooth mapping 
u* : Z{t) X IR+ —)• M"* such that 


dz{x,t) dz{x,t) B{x,f)u*{x,f)) = 0 


at 


dx 


for all X € Z{t) for all t G M'*'. In the case of an uncontrolled 
system, this reduces to the condition for a manifold to be flow 
invariant: ^ -f ^f{x,t) = 0 . 

The objective is to design a controller guaranteeing ex¬ 
ponential convergence to Z{t), i.e. for each x(0) one can 
construct a control signal u{t) such that the solution x(f) of 
( 1 ) satisfies miy^z(t) — y\ < e~^^R for some .R > 0 . 

Assume we can construct a smooth matrix function G(x, t) 
with columns that form a basis for the null space of In 

order to study stability and stabilization of Z{t), we construct 
a “virtual control system”: 


X = f{x,t) + B{x,t)u (13) 

where B{x, t) = [B{x, t) G{x, f)] and u = [u' v']', with u the 
actual control input and v a newly introduced “virtual control”. 

Theorem 3: If there exists a CCM for the virtual control 
system (13) satisfying the strong conditions Cl, C2, then any 
time-varying submanifold of the form Z{t) = {x : z{x,t) = 
c} can be exponentially stabilized (open-loop, sampled-data, 
or continuously almost everywhere) with rate A. 

The proof uses the concept of a “shadow state” x{t), which 
has the property that x(f) € Z{t)flt and can be thought of as 
a generalised projection of x{t) onto Z{f}. The virtual control 
system (13) is constructed so that it can represent dynamics of 
the real system when u = 0, but can also represent x{t) G Z(t) 
when u = x*{x,t) and v is arbitrary. The idea is to ensure 
x{f) converges to x{f), and therefore to Z{f). 

The following corollary gives simple convex criteria for an 
uncontrolled system to converge to a submanifold. 

Corollary 2: Consider an uncontrolled system of the form 
(1) with B = 0 Vx,f. Suppose there exists a uniformly 
bounded dual metric W, invariant on level sets of z{x,t), 
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satisfying: 


dz ( dW 
dx V dt 


dfW +^W + W^ +2XW 
ox ax 


dz' 

dx 


< 0 , 


(14) 

Then all solutions of the system converge exponentially with 
rate A to the set Z{t). 

Note that this corollary is based solely on the existence of 
a universally stabilizing controller. Actual computation of a 
control signal is not required. Corollary 2 generalizes results 
on partial contraction in [33], [34]. The latter showed that 
convergence to a linear manifold defined by z(x) = Vx = Q, 
with V a constant matrix, is guaranteed by the condition that 
1A( )C' is uniformly negative definite. A similar notion 

of horizontal contraction was studied in [15]. 


VI. Illustrative Example 
O ne of the advantages of convex criteria is that it is possible 
to mix and match different design objectives for one controller. 
In [35] and references therein, the problem of “uniting” locally 
optimal and globally stabilizing control was considered. This 
problem is non-trivial in a Lyapunov framework since the set 
of control Lyapunov functions for a system is non-convex, but 
in the CCM framework it is straightforward. Let us illustrate 
this with a particular example system taken from [35], with 
state X = [xi,X 2 ,xz]' and dynamics (1) with 



-Xl + X3 


O' 

fix) = 

x\ — X2 — 2X1X3 + X3 

, B = 

0 


-X2 


1 


Note that this system is not feedback linearizable, since the 
matrix \B,adfB,a(P^B] drops rank at the origin. 

We first solve the linear quadratic regulator (LQR) problem 
for the system linearized at the origin with cost function 
{x'x+ru^)dt with r = 1, obtaining a solution P = P' > 0 
of the algebraic Riccati equation, and the locally optimal 
controller u = —r~^B'Px. Then we can search for W 
and p satisfying (11) and the additional linear constraints 
IL(0) = P~^ and p(0) = 2r~^, so that locally the LQR and 
CCM controllers are the same. To satisfy Condition C2, entries 
of W were allowed to be quadratic functions of xi and X 2 - The 
resulting metric is not uniformly-bounded, but still satisfies 
the conditions of Lemma 1. Similarly, p was a quadratic 
polynomial in Xi, and A = 0.5. As an optimization objective 
we chose the d norm of the coefficients of the polynomial 
entries of W to encourage sparsity. The metric was found 
using sum-of-squares programming [12] via the parser Yalmip 
[36] and solver Mosek, the resulting semidefinite program took 
about 0.4 seconds to solve on a standard desktop computer. 

It can be seen in Fig. 2 that for small initial conditions 
the CCM controller and the LQR are virtually identical. This 
is because the minimal geodesic is close to a straight line 
and p and W are almost unchanged, so the CCM control 
law approximates a simple linear feedback on x — x*. In 
contrast, for larger initial conditions the LQR controller was 
not stabilizing, while the CCM controller was. Simulations 
under LQR diverge rapidly after about 2 seconds. Further 
results on CCMs for poblems in robotics can be found in [37], 
and a method for computing geodesics can be found in [17]. 
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Fig. 2. Response of System (15) with CCM and LQR control to initial state 
a:(0) = [0.5, 0.5, 0.5]^ (left) and (c(0) = [9,9,9]'' (right). This exhibits the 
“locally optimal” and “globally stabilizing” behaviour of the CCM controller. 


Appendix 

Proof of Proposition 1: By assumption that the 

closed-loop system is strictly contracting, we have 
^{5'^M{x,t)5x) < —2X5'^M{x,f)5x for all x,v,t and 
6 x ^ 0. Expanding the left hand side -^{SxM{x,t)Sx) = 

5' 

rn 


y- yj. xxtxxxvx cx«^ ^ xyj. yu., a j 

^+dfM+[^x+BK)'M + M[^^+BK) 


+ J27Li{kz{x,t) +Vi) (db,M + 5x. Note 

that this is affine in Vi, so if this to be bounded for all v G K™, 
it is clearly required that db^M+^'-M+M^ = 0 for each i. 
Furthermore, if S'x MB = 0 then terms involving K vanish and 
hence + dfM + §^'m + M§^ + 2 XM^ Sx < 0, 

and the result follows from direct calculation of A and M. ■ 
Lemma 1: Suppose a dual metric W{x) = M{x)~^ 
satisfies a quadratic bound on its largest eigenvalue: 
'^max(ll^(2;)) < | 2 la: -I- *8^ for all x € M", for some fixed 
matrices 21 , 18 , where | • | is the Euclidean norm. Then there 
exists a minimal geodesic between any pair of points in K". 

Proof: By the Hopf Rinow theorem, the result follows 
if any geodesic segment can be extended indefinitely [21]. 
By assumption, the metric M{x) satisfies the lower bound 
Amin(M(a;)) > \^x+<b\^ - “A geodesic 7(5) defined on 

some interval s G (a, b) C K. Geodesics have constant speed: 
7 'M( 7 ) 7 s = c for some c > 0 , so |7s| < c|2l7-|-25|. This 
implies that I7I grows at-worst exponentially as the parameter 
s -G ±00. Therefore solutions do not exhibit finite escape in 
either direction, so the interval of existence is (—00,00). ■ 

Lemma 2: Consider the system ( 1 ), ( 3 ), and smooth real¬ 
valued “differential storage function” V{x,Sx,t)^ “differ¬ 
ential supply rate” K{x,Sx,t). If for all x,u,Sx ^ 0 ,f 


dV 

M 


dV dV dV 


(16) 


then a “differential feedback controller” ks{x,Sx,u,t) G 
exists that satisfies the following two properties: 

1 ) Closed-loop dissipativity: for all x,u,Sx 

dV dV dV 

dt dx dOx 

2) Path-integrability: for any regular curve c, and any uq G 

G M+, a unique solution of the following integral 
equation exists on s G [0, Ij: 

v{s)=uo+ ksic{s),Csis),v{s),t)ds. (17) 
do 
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Proof: For brevity of notation, let us define 

dV dV^ d\^ 

:= ^ + ^(/ + B,.) + - K 

i9v^ , aF' 


Note that by construction b > 0, and by assumption (16), for 
all X, Sx 7 ^ 0, u, t, either a < 0 or b > 0. Now, define 


p{x,Sx,u,t) 


0 , if a < 0 , 

a+Va^+b^ ^ Otherwise. 


(18) 


It follows from [5, Thm 1] that p is a smooth for all x,6x ^ 
0, M, t. Now we construct the control; 


ki{x, Sx, u, t) = -p{x, Sx, u, t)B(x, t) 


,dV{x,5x,ty 


dSx 


(19) 


Exponential convergence in the Euclidean metric is then 
implied by uniform boundedness of M{x,t). In particular, 
it is straightforward to show that y/dii\x{t) — a;*(f)| < 
d{x*{t),x{t),t) and d(x( 0 ), x*( 0 ), 0 ) < ,/a 2 \x{ 0 ) — a;*( 0 )|. 
Combining with (21) gives: 


y^\x{t) - x*{t)\ < e - a;*( 0 )|, 


i.e. (2) holds with R 



Eor the open-loop control. Lemma 3 implies that for any 
f > 0 we have d{x*(t),x{t),t) < e“^‘L(c(0),0). If the 
minimal geodesic is chosen for c( 0 ) then L(c( 0 ), 0 ) = 
(i(a;*( 0 ), a;( 0 ), 0 ), and so we obtain ( 21 ). 

Similarly, for the sampled-data controller, on each interval 
[ti,ti+i) we have 


d{x*{t),x(t),t) < L{c{t),t) < e 


Substituting into (3) establishes closed-loop dissipativity: 
= a — pb + K = K— Va^ + b'^ < k. 

We now prove path-integrability, i.e. that a solution of (17) 
exists. We will prove this by contradiction. By assumption the 
curve c is regular, so Cs(s) y 0 for all s, so ks is a smooth 
function of its third argument for all s. Hence integrability 
follows unless there is finite escape at some s = s < 1. It is 
clear from (19) that this would imply p —> oo as s —s. 

Eirst, we observe that b > 0 in a neighbourhood of s, since 
if b = 0 then p = 0 , but we require p to blow up. 

Second, we note that the only dependence p has on u is 
via a, which by construction is an s-dependent affine function 
of u. It follows from (18) that if there is a closed interval 
© C [0,1] such that b > 0 for s G G, then p is a globally 
Lipschitz function of m on ©. By standard comparison results, 
e.g., [1, Thm 3.2], a unique solution to (17) exists on this 
interval, which contradicts finite escape at s = s. ■ 

Lemma 3: Given a control contraction metric M{x,t), a 
time interval T = [ti,ti+i] C M"*", and a path c(ti) connecting 
x*{ti) to x{ti), suppose the open-loop control signal in Section 
III-l is applied on T initalized with c, then for all f G T 

d{x*{t), x{t),t) < ti). (20) 

Proof: By construction, c(f, 0) = x*{f) and c(f, 1) = 
x{f) for all t G T. Eurthermore, Cs{t,s) = s) satisfies 
^Cs{t,s) = A{c{t,s),kp,t)cs + B{c{t,s),t)ksit,s) for all 
t G T~, s G [0,1]. 

By construction of kg we have y^{c'gM{c,t)cs) < 
—2Xc'gM{c,t)cs- Integrating with respect to s gives 
-^E{c{f),t) < —2\E{c{t),t) and integrating with respect 
to t gives E{c{t),t) < fi) for t G T, 

with strict inequality for t > ti. Taking square roots gives 
L{c(t),t) < L{c{ti),ti)- Now, for each t the curve 

c{f) connects x*{t) to x{f), and the Riemannian distance 
between these points is the infimum of lengths of such curves, 
so we obtain the bound ( 20 ). ■ 

Proof of Theorem 1: We will show that for each type 
of controller, the Riemannian distance between x{f) and x*{f) 
decreases exponentially: 

d{x*{t),x{t),t) < e“^‘(i(a;*( 0 ), a;( 0 ), 0 ) ( 21 ) 


and then at time a minimal geodesic ^i+i is computed 
which has length T( 7 i+i) = d{x*{U+i),x{ti+i)Ri+i) < 
limi_).t^^j^ L{c{t),t) where the limit in t is from the left. 

Eor continuous feedback, we first show that the given 
controller is smooth on D{x*,t)- It follows from [21, Prop. 
3.5, p. 117] that the mapping {x,x*,t) i—> 7 is smooth. Now, 
it follows from Lemma 2 and the smoothness of p defined in 
(18) that the mapping {x,x*,t) >—>■ u is smooth. 

To show continuity at a: = x*, we first note that since V = 
S'xMSx is quadratic in 6 x, and the differential dynamics (3) 
are linear in 6 x, the small control property of [5] holds, i.e. 
for any e > 0 there exists p > 0 such that for 7 ^ 0 with 
1^x1 < V there exists 6 u with |(5„| < e satisfying E < 0. This 
implies that ks in (19) is continuous in 5x at 5x = 0. 

Let us show convergence of the control law to u* for a 
sequence of states x^ with limfe_).oo = x*{f). It suffices 
to construct the sequence x'^ along a particular but arbitrary 
geodesic 7 °, e.g. x^ = y^{\/k), since all states in a neigh¬ 
borhood of X* lie on such a geodesic [21, Thm 3.7]. Let 7 ^ 
denote the segment from x*{f) to x^. Now, the constant-speed 
property of geodesics states that 117^11, = L( 7 ^^) for all 
s, and so by uniform-boundedness of the metric | 7 g | —> 0 
uniformly in s G [0,1]. Therefore, by continuous dependence 
of ( 6 ) on ks (e.g. [38, Lemma 3.1]) the sequence of solutions 
kp{y^ 1 ) of ( 6 ) converges to u*{t) as fc —> 00 . 

To show exponential decrease in distance, recall [21, Prop 
2.4, pl95] that on D{x*,t) the energy is a smooth function 
of its endpoints, i.e. (a, 6 ) 1 —> E{a,b,f) is smooth for each t. 
Now, consider the open-loop control initialised with ti = t and 
7 for c{ti). This open-loop control is identical to the proposed 
continuous feedback at time t, and therefore x{t) is also iden¬ 
tical. Hence there exists a (non-minimal) path c( ) defined on 
\t,t + f) with c{t) = 7 i satisfying < —2\E{y,t)^ 

therefore ^E{x{t),x*{t),f) < —2XE(x{t),x*(f),t)- Inte¬ 
grating with respect to time gives the result. ■ 

Proof of Theorem 2: Eor the first statement, under the 
feedback transformation we have a new control system affine 
in u: i = (/ -I- Ba) + Bfiv, and the associated differential 
dynamics are of the form (3) with Ay{x, v) = A{x, u(x, v)) + 
B{x) and By{x) = B{x)j3{x). Now, consider the dual 

CCM condition (9). The same annihilator matrix Bx can be 
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used since B'^By = B±BI3 = 0. Now, substitute Ay for A in 
(9), and notice that since B'j^B = 0 the second term (Sff) in 
Ay has no effect. The first term in Ay is just A{x, u) evaluated 
a particular value of u, and (9) holds for all u, and hence can 
be applied under feedback transformation. 

For the second statement, the differential dynamics trans¬ 
forms as + B^6u, with = <i>T' + T’A'I' and 

B^ := ^B. Taking = 'k'MT' and the identity T' = 
-vptpvl/ we have -|- vp'MT' - vk'M'k'hvI/, 

then straightforward calculation gives -f A'^M^ + M^A^ + 
2AMj = {M+A'M-\-MA-\-2\M)^ and the result follows 

from the fact that 5x = The third statement then follows 
by considering points x = ■ 

Proof of Theorem 3: We will construct the open- 
loop controller, but others are analogous to the construction 
for Theorem 1. Since there exists a CCM M{x,t) satis¬ 
fying the strong conditions, we can construct a differen¬ 
tial feedback controller for (13) of the form ks{x,6x,t) = 
— ^p{x,t)B{x,tYM{x,t)Sx- By construction of B this de¬ 
composes as = —^pB'MSx, 5y = —^pG'MSx- Now, for 
a given path c(f) G T{x{t),x{t)) we construct the following 
paths of signals for the real and virtual control inputs: 

u{t,s) =u*{x,t) + [ (5„(c(s),Cs(s),f)ds, (22) 

JO 

v{t,s)=- Sy{c{s),Cs{s),t)ds, (23) 

J S 

noting that §7 = ^« and Therefore, by an analo¬ 

gous argument to Theorem 1, one can construct open-loop, 
sampled-data, or continuous almost-everywhere controllers 
such that the length of c{t) shrinks exponentially. 

Now, notice that at s = 1 we have v{t, 1) = 0, so c(f, 1) = 
/(c(f, !),<)-(- B{c{t, 1), and so c(f, 1) = x{t) for all t, 
i.e. the “real” dynamics are recovered. On the other hand, at 
s = 0 we have the c(f, 0 ) = x{t) (the “shadow” state) with 
dynamics x = f{x,t) + B{x,t)u*{x,t) + G{x,t)ky{t,0). But 
by the assumption that Z is invariant for i = / -f Bu*, and 
that § 7 ^ = 0, it follows that x{f) G Z(f) for all t. 

So, since L{c{t)) —> 0 exponentially and c{t, 1) = x{t) and 
c(f, 0) G Z(t), it follows that x{t) -G Z{t) exponentially. ■ 
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